Re: refresh/expire, directory/search engines, spiders n bots [Was: Re: Page redirect]

by Lori Eldridge <lorield(at)uswest.net>

 Date:  Sat, 9 Dec 2000 09:01:36 -0800
 To:  hwg-basics(at)hwg.org
 References:  sportsstuff gte net
  todo: View Thread, Original
Hi Abhay,

>Lori, I think you're confusing the "refresh" with "expire".

You are right. I was having senior moment :o)

I'm doing it right--I just didn't take the time to read carefully and 
got the two terms confused.

>See, what P.Wilson is pointing out is the use of the first one. You
>must've come across pages which kind of load and then you find
>yourself looking at a different URL altogether.

Right I found one last night on AltaVista--a site that lists car 
dealers (for a fee) and they have 4 urls/sites that all take you to 
the same URL.
>
>You are also confusing search engines with directories. Yahoo! [1] and
>DMOZ [2] are basically directories --- human edited.

I have that down pat also--just was sloppy with my terminology.

>To give you an idea, take a look at Altavista's Submission Policies
>[7] when you are trying to sumbit a URL for it to index. It says, that
>they will exclude, among others:
>  . Machine-generated pages with minimal or no content, whose sole
>    purpose is to get a user to click to another page,
>  . Pages that contain only links to other pages, or
>  . Pages whose primary intent is to redirect users to another page.
>Get the idea?

Yes, I just found the AltaVista Webmaster FAQ this morn and I'm 
devouring it now.

Thanks for your help.

Lori

HTML: hwg-basics mailing list archives, maintained by Webmasters @ IWA